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The significance of the integrated Sachs-Wolfe effect revisited 
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ABSTRACT 

We revisit the state of the integrated Sachs-Wolfe (ISW) effect measurements in light of newly 
available data and address criticisms about the me asurements which h a ve rece ntly been raised. 
We update the data set previously assembled by Giannantonio et all (12008b) to include new 
data releases for both the cosmic microwave background (CMB) and the large-scale structure 
(LSS) of the Universe. We find that our updated results are consistent with previous measure- 
ments. By fitting a single template amplitude, we now obtain a combined significance of the 
ISW detection at the 4.4 <x level, which fluctuates by ~ 0.4 <x when alternative data cuts and 
analysis assumptions are considered. We also make new t ests for systemat i c cont aminations 
of the data, focusing in particular on the issues raised by Sawangw it et al.l d2010t) . Amongst 
them, we address the rotation test, which aims at checking for possible systematics by cor- 
relating pairs of randomly rotated maps. We find results consistent with the expected data 
covariance, no evidence for enhanced correlation on any preferred axis of rotation, and there- 
fore no indication of any additional systematic contamination. We publicly release the results, 
the covariance matrix, and the sky maps used to obtain them. 

Key words: Cosmic background radiation; Large-scale structure of the Universe; Cosmol- 
ogy: observations. 
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1 INTRODUCTION 

Observational evidence indicates the expansion of the Universe 
is accelerating at late times, which may be explained by a small 
cosmological constan t, some negative-pressure dark energy fluid 
dFrieman et al. 2008), by m odifications of the laws of gravity 
(see e.g. IClifton et al]|2012l) . or by some n on-trivial distributio n 
of the local large-scale structure (see e.g. iDunsbv et al.l |2010|) . 
Evidence for this acceleration is provided by multiple comple- 
mentary probes, such as observations of distant Type la su- 
pernovae dAmanullah et alj |201C| : iLampeitl et alj l2010allbl). cos- 
mic m icrowave background (CMB) aniso tropies dKomatsu et alj 
201 lh. baryon aco ustic oscillations (BAO) lEis enstein et alj|2005l ; 



Percival et al .2010), clusters of galaxies ( Rozo et al .l2010h and the 



integrated Sac hs-Wolfe (ISW) effect dGiannantonio et alj [2008b; 
iHo et alj|2008l) . 

We shall focus here on the latter, which consists of small 
secondary fluctuations in the CMB which are produced whenever 
gravitational potentials are evolving, as happens at late times in 
the case of the Universe underg oing a transition to a curvature- or 
dark energy-dominated phase (Sachs & Wolf el 19671) . If we assume 
a flat universe as supported by the primary CMB data, then a de- 
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tection of the ISW represents a measurement of dark energy and 
its properties. Unfortunately, the amplitude of the ISW signal is 
small compared with the intrinsic CMB temperature anisotropies, 
contributing to the signal only at large scales. To overcome this, 
a technique was introduced to extract the ISW signal by cross- 
correlating the observed CMB with tracers of the local large-scale 
structur e (LSS) of the Universe, such as wide-area galaxy cata- 
logues dCrittenden & Turok| [l996). As we will review below, this 
method has been used to successfully detect this signature of dark 
energy by many authors using several different LSS catalogues and 
the WMAP data of the CMB. More recently, multipl e data sets were 
analysed jointly to maxim ise the extracted signal dHoetal.| [2008; 
iGiannantonio et alj 12008b) (G08 herein), thus detecting the ISW 
signal at an overall significance of ~ 4 <x, when fit a single ampli- 
tude. 



However, some concerns h ave been raise d abou t 
these detections, notab ly by [ Sawangwit et al. {2010h ; 
Francis & Peacockl d2010dlb|); iHerna ndez-Monteagudo (2010); 

three 



Lopez-Corredoira et al 



l201fl). These concerns relate to 
main areas: conflicting estimates of the statistical significance; 
searches based on new photometric data sets; and the possibility of 
larger than expected systematic contaminations. 

The purpose of this paper is twofold. First we update our anal- 
ysis to include the latest data of both the CMB and the large-scale 
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structure, using the 7-year WMAP maps and the latest available re- 
leases of the Sloan Digital Sky Survey (SDSS); we also publicly 
release the results of our analysis and our sky maps. Second, we 
evaluate the above-mentioned criticism and re-assess the overall 
state of the ISW m easurements, focusing in particular on address- 
ing the concerns by Sawan gwit et alj 12010) (S10 herein). 

The plan of the paper is as follows: after reviewing the anal- 
ysis techniques and the current state of the ISW measurements in 
Section |2] we will describe our updated data set and the publicly 
released maps in Section [3] We then move on to a discussion of 
systematic uncertainties in Section [4] where we address a partic- 
ular type of systematic test which has been discussed in S10 (the 
rotation test), finding results consistent with those expected given 
the covariance of the data. Further issues raised by S10 and other 
authors are addressed in Section [5] before we conclude in Section 

m 



2 THE STATE OF THE ISW 
2.1 Theory 

The ISW effect dSachs & Woifel 1 19671) is a secondary source of 
temperature anisotropy which is produced whenever the gravita- 
tional potentials O and are evolving in time, generating temper- 
ature anisotropics of the form 
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v(n) = - J e- Ta (6 + *) [I,, h(r, - rj)] dr, , 



(1) 



where r\ is conformal time, the dots represent conformal-time 
derivatives, t is the optical depth, and e~ T(z) is the CMB photon 
visibility function. In the best-fit cosmological model, consisting 
of cold dark matter and a cosmological constant (ACDM), such 
anisotropies are generated at early times during the transition from 
radiation to matter domination and at late times, when dark energy 
begins to dominate, so these two contributions are known as the 
early and late ISW effects. 

The early effect is typically generated shortly after recombi- 
nation, so it is peaked around / ~ 100, and its contribution to the 
total CMB (which is small in the standard ACDM case) can be 
used to constrain the energy content of relativistic s pecies, such as 
the n umber of neutrino species and their masses jlchikawa et alj 
2008), the presence o f hot-dark-matter candi dates such as massive 
neutrinos and axions (Hannestad et al. 2010), and interacting dark 
energy models dValiviitaetal]2010l) . 

We focus here on the late effect as a probe of dark energy; 
in this case, the amplitude of the perturbations is also small com- 
pared with the primary CMB, and the fluctuations are generated on 
the largest scales, meaning that the effect is well described by lin- 
ear theory. However, there is a small additional contribution from 
the n on-linear growth in c lusters, known as t he Rees- S ciama ef- 
fect dRees & Scia ma 1968). Fo r a rev iew, see ICooravl d2002h : in 
more recent work, ISmith et al] d2009l) provide a comparison with 
,/V-body simulations and perturbation theory, and lCai et alj j201Ch 
give a comparison of linear and non-linear effects on the recon- 
structed ISW maps from ray tracing of CMB photons through N- 
body simulations. Finally, Schaf eret alj J201 lh quantify the param- 
eter estimation bias due to this non-linear effect and show that it is 
small compared to the statistical uncertainty imparted by cosmic 



2.1.1 Cross-correlations 

Despite the small amplitude of the late ISW anisotropies, they can 
be used to constrain dark energy, as their presence can be detected 
by cross-correlating the observed CMB with t he local matter den- 
sity, w hich traces the gravitational potential dCrittenden & Turokl 
1996). The CMB temperature anisotropy ®i SW (n) is given by 
Eq. |QJ, and the galaxy density contrast S g (h) can be calculated as 



S g (n) = b g (n, z) <p(z) S(h, z) dz , 



(2) 



where S(n, z) is the dark matter density perturbation (linear theory 
suffices as described above), b g the (linear) galactic bias and (p{z) is 
the normalised visibility function of the chosen galaxy survey. This 
enables us to calculate the cross power spectrum, 
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(3) 



where P(k) is the matter power spectrum (linear theory suffices as 
well), and the source terms are, if we consider only the ISW tem- 
perature anisotropies, 
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dzb g (k,z)<p(z)S(k,z)j l [k X (z)], 



(4) 



where the tilde denotes Fourier transformation and the /; are the 
spherical Bessel functions. The auto-power spectra for the galax- 
ies Cf and the CMB (either the ISW part only tf T lsw or the 
full observable spectrum Cf T ' lM ) can also be calculated by using 
the relevant source terms accordingly. In this work we calculate all 
the theoretical predictions implementing the ab ove equations into a 
modified version of the CAMB integrator code dLewis et alj|2000l) . 
without using the Limber approximation. 

Notice that in the ACDM model and in most of its vari- 
ants, as long as secondary Doppler effects due to reionisation can 
be neglected I Giannantoni o & Crittend en 2007), the only signifi- 
cant source of large-angle CMB-density correlation is the ISW ef- 
fect: we will therefore use the simpler notation Cj s for the cross- 
correlations. 



2.1.2 Signal-to-noise 

The maximum signal-to-noise (5 IN) ratio which is achievable for 
the ISW is limited by the amplitude of the primordial CMB pertur- 
bations. For an idealised f ull-sky full-depth survey, one can write 
dCrittenden & Turokll 19961) 



(S\ 2 ^ Ci 
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for the current WMAP7 ACDM model dKomatsu et~al]|201lh de- 
scribed below in Section [3] this limit amounts to S/N < 7.6, as 
shown in Fig. [T] A more realistic estimation which takes into ac- 
count the limitations of a galaxy survey, such as its redshift distri- 
bution, its shot noise due to finite surface de nsity n s (in sr -1 ) a nd its 
sky coverage / sky , is given by (see e.g. G08: ICabre et al.|[2007h : 



(§)~^2> +1 >' 
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(6) 
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Figure 1. Theoretical spectra and maximum signa l-to-noise of the ISW 
detection for the current WMAP7 best-fit model iKomatsu et all 1201 ll) . 
The top panel shows the angular temperature power spectrum of the ISW 
(green, solid) co mpared with the tot al CMB (red, dashed) and the data from 
WMAP7 (blue) dLarson et alj201 lb . The bottom panel shows the maximum 
signal-to-noise (per mode and cumulative) achievable given the same model 
as given by Eq. {5} (brown, dot-dashed), as well as the improvement using 
CMB polarisation given by Eq. GO (blue, solid). 



Applying this expression to detections coming from current single 
galaxy catalogues typically yields only moderate significance (2 < 
S/N<3). 

Early attempts were made to measure the two-point cor- 
relation between COBE C MB data and tracers of the LSS 
dBoughn & Crittendenll2002h . but these were limited by the noise 
and resolution of the COBE data. However, the ISW effect 
was soon detected using the WMAP data by many different 
groups exploiting a range of techniques; the first detection by 
iBoughn & Crittenden! 1 120041) used the X-ray background from the 
HEAO satellite and radio-galaxies from the NVSS survey, and was 
followed quickly by many others as we review below. 



2.2 Single catalogue measurements 

The first ISW analyses were focused on detection at any signifi- 
cance, measuring the two-point correlations of the WMAP CMB 
data and galaxy catalogues. This analysis can be performed equiv- 
alently in the real or harmonic spaces, using cross-correlation func- 



tions or cross power spectra. While these approaches are formally 
equivalent, in practice some small differences can arise. 



2.2.1 Cross-correlation functions 

In real space, the observable quantity is the cross-correlation func- 
tion (CCF) between CMB temperature and galaxies defined as 



(1) 



where the average is carried out over all the pairs of directions in 
the sky lying at the given angular separation & = |ft] - n 2 |. This 
approach has the advantage of being computationally straightfor- 
ward, since the sky masks are defined in real space and are easily 
treated; the main drawback is the high level of covariance between 
the measured data points. 

Following the release of the WMAP data, several groups 
reported positive detections using a wide range of LS S cata- 
logues: the first measurement by Boug hn"& Crittenden! ( 2004) 
used a combination of NVSS radio galaxies and X-ray back- 
gr ound data, and the NVSS result was independently confirmed 
by iNolta et al.l d2004h. For opt ical surveys, indications were seen 
by |Fosalba & Gaztanaga (2004) using the APM sur vey, and the ev- 
idence was improved by iFosalba et alj d2003l) and IScranton et alj 
d2003h by us ing Lu minous Red Galaxies (LRGs) from the SDSS. 
ICabre et alj d2006t) detected the effect using the main SDSS 
galaxy sample, which while shallower, c ontains more galaxies 
than the LRG sample; feassat et al, (2007) re-examined the rela- 
tively shallow 2MASS infrared survey, which was originally a nal- 
ysed with the powe r spect rum method bv lAfshordi et alj ( 120041) . In 
iGiannantonio et al] d2006t) . we reported the highest-redshift detec- 
tion of the ISW with a catalogue of qua sars from the SDSS, which 
was later reanalysed bv lXia et"al] d2009l) . 

Most of these papers report a positive detection at low signif- 
icance, typically between 2 and 3 tr. One exception is the analysis 
using the 2MASS data where, though it favours the expected ISW 
signal, the evidence is very weak because the sample is too shallow 
for an appreciable ISW signal; it also is believed to have significant 
contamination from the Sunyaev-Zerdovich (SZ) effect. 



2.2.2 Cross-power spectra 

We can also attempt to measure the angular power spectra of the 
cross-correlation directly. The main advantage of this approach is 
the relative decorrelation of the different modes, which makes the 
localisation of the signal on different scales more straightforward; 
the drawback is that the estimator of the correlation involves the 
inversion of a matrix whose dimensionality is the number of pixels 
over which the maps are projected (N p i x ), which is computationally 
challenging, especially in realistic cases where the geometry of the 
survey mask is complex. For these reas ons, approximate methods 
are generally used (for details, see e.g. IPad manabhan et alj 20031; 
Efstat hloull2004l ; Iffirata et al.ll2004| ; iHo et alJl2008l ; ISchiavon et alj 
I2012I) , which still yield considerably lower correlation between 
modes when compared to cross-correlation measurements. 

In this way, positive detections were reported by 
lAfshordi et all d2004l) using the 2MASS catalogue, who si- 
multaneously fit_a_Jemrjlate_Jor the SZ effect; this was recently 
revisited by iFrancis & Peacock d2010bl) who found weaker evi- 
dence more consiste nt with Rass at et alj d2007h and other analyses. 
Padmanabh an et al] {2005) applied the cross-spectrum technique 
to a SDSS LRG sample, and found consistent significance levels 
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to the earlier work, at about 2 tr. More recently, iGoto et all feOlA 
measured the correlation between WMAP and the Wide-field 
Infrared Survey Explorer (WISE) survey, finding a high ISW 
signal at > 3 a. While the WISE volume is ~ 5 times larger 
than 2MASS, and thus the expected signal is higher, such a high 
correlation is ~ 2.2 a higher than the ACDM expectations. Future 
analyses with the upcoming larger WISE data releases will help to 
clarify this issue. 

Given accurate covariance matrices, cross-correlation and 
cross-spectra measurements (using the same data), should yield 
identical results, as, in total, both measurements contain the same 
information. 



find that this improves the upper limit to S/N < 8.7, as shown in 
Kg.Hl 

Most of the approaches effectively measure a two-point statis- 
tic of the average correlations between CMB and LSS over the 
whole region covered by the surveys; however, with wavelets it 
is possible to try to localise sources of th e ISW effect. This was 
more directly attempted by iGranett et al] §008), who identified 
massive superclusters and voids of galaxies in the SDSS LRG sur- 
vey and their corresponding regions from WMAP were stacked to 
maximise the signal. A high significance detection was reported 
(at 4.4 o" from this LRG catalogue alone), although this result was 
strongly dependent on the number of superclusters and voids used. 
See below Section |5.1.6| for a more detailed discussion. 



2.2.3 Other techniques 

The ISW effect has also be en seen using a m e thod based on 
a wavelet d e composition by Ivielva et alj fc006l) ; iMcEwen et alj 
j200ll2008h : IPietrobon et atl d2006r) . who explored its dependence 
on different wavelet shapes and scales. While the significance level 
was sometimes reported to have been enhanced with this technique, 
the resulting constraints on cosmology were comparable with the 
previous two methods. 

As the ISW is maximum on the largest scales, it is affected 
by the local variance, i.e. by the particular realisation of the mat- 
ter distribution given the power spectrum; this may bias the results. 
For this reason, more advanced methods were developed to sub - 
tract the local v arianc e, e.g. by IHernandez-Monteagudol j2008l) ; 
Frommert et al ] j2008h . In the latter work, a Wiener filter recon- 
struction of the LSS was used as a template instead of the theo- 
retical cross-correlation function; it was estimated that this method 
may increase the S/N ratio by 7% in average. 

It is also possible to reconstruct the IS W temperature maps. 
This was attempted bv lBarreiro et alj J2008h u sing NVSS data and 
a Wiener filter method, and by IGranett et alj d2009h using SDSS 



data (see Sect ion | 5.1.6b. Anothe r optimised method has been later 
introduced bv lDupe et alj d201ll) . based on the analysis of the tem- 
perature and density fields themselves rather than their spectra. A 
useful byproduct of this procedure is that a map of the ISW sig- 
nal in the CMB is obtained. These authors also highlight the im- 
portance of separating the different statistical analyses, defining 
different procedures for testing the detection of a correlation in a 
model-independent way, measuring the confidence level based on 
a template, and comparing different models. This method was then 
validated with the 2MASS data, recovering a weak positive detec- 
tion. 

Another strategy to improve the signal-to-noise is to 
use the CMB polarisation information t o reduce t he pr i- 
mary CMB anisotropics, as proposed b y ICrittendenl (2006); 
iFrommert & Enfilinl 12009); Liu et al. I J201 ]]). Depending on the de- 
tails of the method, different authors estimate a level of improve- 
ment in the significance of the ISW detection in the range between 5 
and 20%. In more detail, the correlation Cj E between CMB temper- 
ature and polarisation (E-modes) can be used to reduce the amount 
of primary anisotropies in the total temperature spectrum. Assum- 
ing idealised data, the maximum signal-to-noise of Eq. $5$ is thus 
increased to 



c 



(cr)/c/ 



(8) 



2.3 Multiple catalogues measurements and their applications 

The significance of the ISW detections can be increased by combin- 
ing measurements obtained with multiple catalogues, to improve 
from a simple detection t o para meter estimation and model com- 
parison. Gaztana ga et alj J2006I) made a first attempt at collecting 
all the existing measurements and used the resul ting compilation 
to con strain cosmology; this was also extended bv lCorasaniti et all 
d2005h . 

The difficulty with combining multiple measurements is 
achieving a reliable estimation of the covariance between them. It 
was proposed that a fu ll tomographic analysis should be performed 
(Pogo sian et al.1120051) . including all the signals, and their covari- 
ances, as a function of red shift. This was finally achieved inde- 
pendently by Ho et al. (2008), using the harmonic space estimator, 
and by I Giannantonio et al] j2008bh in real space, using fivj] and 
six galaxy catalogues respectively, summarising the state of the art 
in the field and upgrading the significance to 3.7 a and 4.5 a re- 
spectively. These results have been us ed to test a variety of dark 
energy and modified gravity models jGiannantonio et alj [2 008a; 
iGiannantonio et al] |2010| ; Lombriser et al. 2009; Lombris er et alj 
| 2012| ;| Lombriserl201 lMValiviita & Giannan tonio 2009; Ser ra et ai] 
l2009l ; lDaniel et al.l2009l ; lzhao et alJl2010l ; lBertacca et al]201ll) ; in 
the modified gravity case, the ISW provides a particularly useful 
constraint because it is sensitive to any non-trivial evolution of the 
gravitational potentials and the effective anisotropic stress. 



2.4 Potential issues 

Alongside these developments, some studies have questioned in- 
dividual aspects of the ISW measurements, raising some doubts 
about th e significance of its detectio n. 

In iFrancis & Peacockl feOlOal lbl). the 2MASS-CMB cross- 
correlation was re-analysed, and it was found that there is little 
evidence for an ISW detection from this catalogue alone, which is 
in agreement with most previous literature. But more worryingly, 
these authors also state that the ISW signal may remain undetected 
in 10% of cases (see Se ction |5.1.3|belo w). 

In IHernandez-Monteagudol ( I20101) . the NVSS catalogue was 
re-considered, looking at its auto- and cross-correlation functions 
in both real and harmonic spaces. In both cases, some cross- 
correlation was seen, but the paper expressed concerns regarding 
a lower than expected signal on the largest scales and anomalous 



For the current WMAP7 ACDM model (Komatsu et al. 2QlT|), we 



1 In the analysis bv lHo et al] (2008!) some of the catalogues where subdi- 
vided further into sub-samples. 
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large-scale structure in the NVSS map. We discuss these issues in 
Sect ionl5~i31 

ISawangwit et reanalysed some of the earlier ISW 

measurements and extended the analysis with three new LRG data 
sets, including a high-redshift sample developed using AAOmega 
spectra. The two catalogues at lower z were found to be in general 
agreement with a positive ISW signal, although at lower signifi- 
cance than seen elsewhere in the literature, while the high-redshift 
AAOmega sample showed no significant correlation. These authors 
also discussed the effect of possible systematics, suggesting that 
there is evidence of strong residual systematics from the study of 
data generated by rotating the real maps. We explore the rotation 
tests for our data and for the S10 data in Section l4~2l we then dis- 
cuss the new data sets by S10 in Sect i onl5.2l 

Finally. FLopez-Corredoira et al.l {2010) reviewed some of the 
correlation analyses, finding levels of signal comparable to previ- 
ous measurements, but significantly higher levels of uncertainty. 
We discuss this further in Section |5,l,4| 



3 UPDATED DATA SET 

We have updated our data compilation from G08 to include the 
latest available data for both the CMB and the LSS. All the d ata 
sets are pixellated in the Healpix scheme ( Gor ski et al J 120051) at 
a resolution of A^ide = 64, corresponding to a pixel side of 0.9 
degrees, as previously done in G08. We have checked that higher 
resolutions give consistent results. 

In the following analysis, unless otherwise stated, we assume 
a fiducial flat ACDM cosmology, which we here update to the lat- 
est best-fit model from WMAP7+BAO+//o> defined by energy den- 
sities for baryons a>i, = 0.0226, cold dark matter a> c = 0.1123, 
sound horizon at the last-scattering surface 100)?, = 1.0389, op- 
tical depth t = 0.087, spectral index and amplitude of primor- 
dial scalar perturbations n s - 0.963, A s = 3.195, referred to a 
pivot scale k pwot = 0.002 fr/Mpc dLarson et al.l201 ll i lKomatsu et alj 

Eoiib. 

We summarise in TableQ]the most important properties of the 
data sets we use. 



3.1 CMB data 

The original data set by G08 was obtained by analysing the maps 
from the third year of WMAP, and it was checked upon the re- 
lease of the WMAP five-year data that it yielded consistent re- 
sults, as mentioned in Section IV.B of G08. Here we h ave updated 
the w hole analysis by using the latest WMAP7 data jjarosik et alj 
Honl), which should give a more stable foreground subtraction and 
noise reduction due to the increased integration time. 

As for the choice of frequency, we use the internal linear com- 
bination (ILC) map and we also use the most aggressive galaxy 
mask associated with it, again on the basis that this should include 
the best foreground subtraction. We have checked that the signal 
does not change significantly between the different WMAP data 
releases, and that it is reasonably frequency-independent and close 
to the ILC result in the range of the WMAP bands Q, V, W. We 
discuss this further below. 



3.2 Main SDSS galaxy data 

The main galaxy distribution from the SDSS has been extended 
from Data Release Six (DR6) to the final imaging SDSS-III (DR8) 



public data release dAihara et alj|201 fl) . These galaxies have been 
selected using the same criteria as in G08, i.e. starting from the 
photo-z primary galaxy sample (mode=l , type=3), which con- 
tains 208 million objects, and then imposing a cut in redshift of 
0.1 < z < 0.9 and a cut in flux of 18 < r < 21, where r is the r-band 
model magnitude corrected for extinction. Also, only objects with 
photo-z uncertainty of cr z (z) < 0.5 z were considered. This leaves 
us with ~ 40 million galaxies, with a redshift distribution centred 
around z — 0.3. As the distribution of the photo-z's can occasion- 
ally be inaccurate, for the calculation of the theoretical predictions 
we used a fit to a distribution function of the form introduced by 
ISmail et all i ll 9941) and given by 



tp(z) 



1 



z a 

p-^l ex p 



(9) 



where the best-fit values of the parameters are a = 1.5, j3 = 2.3, 
Zo = 0.34; this fitted redshift distribution is similar to the DR6 re- 
sult. 

The mask was derived from a higher number density sample of 
the SDSS galaxies, selected with the weaker conditions r < 22 and 
Az < z (120 million objects), which was pixellated at a higher reso- 
lution (A^jdc = 512) and finding the number of filled high-resolution 
sub-pixels in each low-resolution pixel. Each low-resolution pixel 
was then assigned a weight ff proportional to the fraction of high- 
resolution pixels which were filled. 

An additional subtlety here is to avoid biasing the mask due 
to the high-resolution pixels which are on the edge of the survey 
themselves. We have found that the count-in-cells distribution of 
the 120 million galaxies in the high-resolution pixels is well ap- 
proximated by a log-normal distribution of median /j = ln(110), 
and is even better fit by the g ravitational quasi-equil ibrium distri- 
bution (GQED), described bv lYang&Saslawl ( l201 l|). By compar- 
ing the best-fitting GQED distribution with the data, we found that 
the survey's edges introduce an enhanced tail in the distribution at 
low occupation number which leads to a bias in the mask. For this 
reason, we remove from the mask all high-resolution pixels with 
n < 40, since the best-fit GQED is nearly zero below this point. We 
found that our results are not overly sensitive to reasonable differ- 
ences in the value chosen for this threshold. 

We then mask the sky areas most affected by galactic extinc- 
tion, dropping all pixels where the median extinction in the r band 
is A r > 0.18. We have found that increasing this cut to the stricter 
level of A, > 0.16 only changes the observed CCF by 5%. The 
unmasked survey area increased from 7,771 pixels (or 16% of the 
sky) for DR6 to 1 1,715 (or 24 %) for DR8. The DR8 is the first data 
release to include a significant fraction of data from the Southern 
galactic hemisphere. We have checked that no significant differ- 
ence appears when excluding data from the Southern hemisphere: 
the differences in the observed CCF are at the 10% level. 

We estimated the galactic bias by fitting the ACDM prediction 
to the observed auto-correlation function (ACF), and found a value 
b = 1.2 assuming a scale- and redshift-independent bias. 



3.3 Luminous Red Galaxies 

We update the c atalogue to include th e latest data release of the 
MegaZ LRGs bv lThomas et alj d201 lbh . which corresponds to the 
SDSS DR7, increasing our previous DR6 coverage by 10%. We ap- 
ply the completeness cut in the de-reddened deVacouleurs i mag- 
nitude suggested by the authors (i^y - A, < 19.8) and we limit 
the star-galaxy separation parameter to 6 sg > 0.2. We finally ap- 
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Catalogue 


band 


N after masking 


,/*> 


n s [sr '] 


z 


b 


2MASS 


IR 


415,459 


0.531 


6.23 ■ 10 4 


0.086 


1.3 


SDSS gal DR8 


Optical 


30,582,800 


0.253 


9.60 ■ 10 6 


0.31 


1.2 


SDSS LRG DR7 


Optical 


918,731 


0.181 


4.03 ■ 10 5 


0.50 


1.7 


NVSS 


Radio 


1,021,362 


0.474 


1.72- 10 5 


1.05 


1.8 


HEAO 


X 


N/A (flux) 


0.275 


N/A (flux) 


0.90 


1.0 


SDSS QSO DR6 


Optical 


502,565 


0.168 


2.39 ■ 10 5 


1.51 


2.6 



Table 1. Summary of the properties of the LSS catalogues used. We report the number of objects after masking N, the sky fraction f^ y , the surface density 
of sources n s , the median redshift of their distributions z and the galactic bias b assumed constant needed to fit the auto-correlation function assuming the 
WMAP7 cosmology. 



ply the reddening mask and discard pixels of median extinction at 
A r > 0. 18 as in the main galaxy case. As above, increasing this cut 
to the stricter level of A r > 0. 16 only changes the observed CCF by 
5%. The redshift distribution in this case peaks around z = 0.5 and 
is smooth, and we use it directly as done in G08 . The mask for the 
LRGs is that provided bv lThomas etafl ( 1201 lbl) . with the addition 
of the aforementioned extinction mask. The bias of this catalogue 
is found to be b = 1.7, again by fitting to the measured ACF. 



3.4 QSO data 

For the quasars, no updated catalogue i s yet publicly availabl e, and 
here we use the same DR6 catalogue (Rich ards etai] [2009) as in 
G08, limiting ourselves to the cleaner subset of l/VX-selected ob- 
jects. To reduce the stellar contamination, which is more of an issue 
for quasars, we choose here a stricter extinction cut discarding pix- 
els of A, > 0. 14. Increasing this cut to the stricter level of A r > 0. 12 
changes the observed CCF by less than 10%. 

In this paper we used Eq. ([9} to determine a fit to the QSO 
redshift distribution, for the same reasons described in Section [3~2l 
and obtained best-fit parameters of a = 2.0,/? = 1.5, zo = 1.06, cor- 
responding to a median z = 1.5. This is changed from G08 where 
the visibility function was simply binned, and not smoothed, and 
so included irregular steps between adjacent bins. 

The linear bias parameter found from the QSO ACF is b = 2.6, 
10% higher than that reported in G08. The amount of stellar con- 
tamination, as seen by comparing the large-scale power in the ACF 
with the ACF of a catalogue of stars from the SDSS, is consis- 
tent with a fraction k = 2%, which is expected in these data 
dRichards etai]l2009h . 



3.5 Other data 

For the other surveys (2MASS, HEAO, and NVSS), we continue 
using the same maps as in the previous analysis of G08. However, 
we have improved the analysis in the following ways: 

For the low redshifts probed by 2MASS, non-linear effects are 
large enough to significantly affect the zero-lag bin of the ACF; this 
was seen b y comparing the lin ear power spectrum with the result 
obtained by Smi th et al] J2007I) at the scale of one degree. We have 
therefore dropped this bin which is significantly higher than the 
linear theory prediction, so that the linear bias has decreased to 
b = 1.3 in this case. 

For NVSS, a well-known issue is the uncertainty in the red- 
shift distribution of the sources. Significant changes to the redshift 



distribution can affect the cross-correlation template, and so im- 
pact the detection significance, and will also change the predicted 
ACDM cosmology amplitudes. Here we have compared the cor- 
relation function s obtained using the distri bution function based 
on the models of Dunlop & Peacock ( 1990) (used in G08), to the 



distribution from iDe Zotti et alj ( 2010h . who fitted the template 
based on radio galaxies wit h measured reds hifts, and the distribu- 
tion function introduced bv lHoetalJl200iR who simultaneously 
fit the cross-correlation functions between NVSS and other galaxy 
catalogues. As seen in Fig. [2] the theoretical predictions for these 
models are compatible within the expected measurement error bars. 
We find that the resulting significance of the NVSS ISW detec- 
tion changes at most by 10% when using each of the three models 
for the source distrib ution. In the following, we use the model by 
IDe Zotti etall 12010), as it is based on a subsample of galaxies of 
known redshifts. Further, we have included a better modelling of 
the shot noise in the ACF, due to the fact the maps were originally 
pixellated at a lower resolution. This primarily affects the ACF, and 
so the measurement of the bias; we now find b = 1.8, increased 
from b = 1.5 previously assumed in G08. 

For the HEAO catalogue, we have also included the same 
pixellation correction in the shot noise modelling, but as the instru- 
mental beam is much larger (i?fwhm = 3.04 degrees), the resulting 
bias parameter remains b = 1.0. 



3.6 Method 

We pixellate all these data on the sphere as described above, and 
measure the two-point functions between them and the CMB, using 
the simple estimator 



1 \ plJ i 

v t s($) = — y 



(«; - n) 



(10) 



where rc, and T, are the number of galaxies and the CMB temper- 
ature in a pixel of masked weights ff, fj respectively, h, f are the 
average number of galaxies per pixel and average temperature, and 
N,f = YiijfffJ is me weighted number of pairs at a given sepa- 
ration. Note that in our approach the CMB weights fj are simply 
taken to be either or 1, depending on whether the pixel is masked 
or unmasked. When ff < 1, which occurs mostly at the edges of 
the surveyed area, the number of galaxies in a pixel n, needs to be 
rescaled from the observed number n° bs as n, = n° bs / ff , in order to 



2 Note the typo in Eq. (33) of lHo et all J2008l) . where the argument of the 
Gamma function should be (a + 1) to ensure the stated normalisation of 
/ f(z)dz = feeff- 



© 2012 RAS, MNRAS 000,rflfT9l 



The significance of the integrated Sachs-Wolfe effect revisited 7 



Dunlop & Peacock 
de Zotti et al. 
Ho et al. 




Dunlop & Peacock 
de Zotti et al. 
Ho et al. 




Figure 2. The redshift distribution of NVSS and its effect on the ISW corre- 
lation. In the top panel we show three normalised selection functions which 
have been used widely in the literature, and in the bottom panel the result- 
ing theoretical cross-correlation functions, compared with our data, for the 
fiducial ACDM model. The bias is constant, and set to b = 1.8 for the first 
two models as this gives good agreement with the ACF. It is b — 1.98 for 
the last model, as fitted by Ho et al. (2008). We can see that the differences 
are small compared with the measurement error bars. We use the model by 



are small compared v 
|Pe Zotti etaTTfeOlOl) 



in the main analysis. 



keep the same mean density h over the whole map. As in G08, we 
use 13 angular bins linearly spaced between and 12 degrees. 

We estimate the full covariance matrix C using the 'MC2' 
Monte Carlo method described in G08; specifically, based on the 
fiducial flat ACDM cosmology, we generate Gaussian random 
maps of the CMB and of all the galaxy catalogues, using their 
known redshift distributions, number densities, and including all 



the expected correlations between the catalogues. We also add the 
expected level of Poisson noise based on the surface densities of 
each catalogue on top of all realisation of the Gaussian maps. For 
each of 5000 realisations of these maps, we measure the correla- 
tion functions, and calculate the covariance of them. (See the Ap- 
pendix of G08 for more details.) We have confirmed that 5000 re- 
alisations are enough for convergence of the signal-to-noise. As the 
cross-correlations are in agreement with the fiducial ACDM cos- 
mology used in the mocks, we expect this modelling of the covari- 
ance should be reasonably accurate. See below Section [5. 1.11 for 
more details and a comparison with the analytic covariance. Most 
catalogues are significantly covariant; the samples which are less 
covariant with the others are the LRGs and the QSOs, because of 
their unique redshift coverage, which is more peaked in the former 
case, and deeper in the latter. 

We fit the amplitudes assuming the cross-correlation functions 
are Gaussianly distributed; this is approximate, as even if the maps 
themselves are Gaussian, as assumed in our Monte Carlos, two 
point statistics of those maps will not be Gaussian. However, this 
appears to be a reasonable approximation for correlation functions 
(and particularly cross-correlations), where each bin represents an 
average of many products of pixels and the central limit theorem 
should apply. This is confirmed in our Monte Carlos, where we 
find the skewness in the covariance to be relatively small, with di- 
mensionless skewness measure of 0.1 - 0.2. However, it may be 
worth further investigating any residual bias which this level of 
non-Gaussianity might cause in future work. Non-Gaussianity is 
likely to be a more significant concern for power spectrum estima- 
tors, particularly for auto-spectrum measurements which must be 
positive-definite. 



3.7 Results and public release 

The results of the new cross-correlation analysis are shown in 
Fig. [3] and are in general agreement with G08 given the measure- 
ment errors. We can see that all the measurements lie close to the 
ACDM prediction; however the LRGs do show an excess signal at 
the > 1 a level. See Section|4]for a discussion of possible system- 
atic effects. 

The only CCFs for which we see a non-negligible change in 
Fig. [H compared to the earlier analysis by G08 are the LRGs and 
the NVSS, where the signal has somewhat increased. This appears 
to be primarily due to changes in the WMAP data rather than in the 
LSS surveys; in Fig. [4] we show the CCFs resulting when the cur- 
rent LSS maps are correlated with different WMAP data releases. 
With the exception of the LRGs, the changes tend to bring the data 
into better agreement with the ACDM theory. We have found that 
similar changes appear if the single-frequency, cleaner maps (V and 
W) are used instead of the ILC. Further, we found that a significant 
part of these changes is induced by the change in the WMAP mask 
between the different releases rather than the change in the data 
themselves, suggesting that the differences may be due to a better 
foreground cleaning. 



To provide a global estimate of the combined significance, we 
use a theory template vD rs (i?,) = Ag(&j), where g(i?,) = g, is the 
theoretical prediction of the WMAP7 best fit model and A is the fit 
amplitude for each catalogue; further details can be found in G08. 
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. ACDM theory G08 data 

best ampl. fit updated data 

Figure 3. Updated results of the cross-correlation of all the data sets with the WMAP7 ILC map. Most data (dark green, solid) are in good agreement with the 
theoretical predictions for a ACDM model (red, short-dashed), with the only exception of the LRGs which show an excess at > 1 -cr level. The highly correlated 
error bars are from 5000 Monte Carlo mocks and are 1-cr, except for 2MASS where they are 0.5-cr to improve readability of the plot. Further, the first five data 
points for 2MASS have been excluded due to potential contamination by the SZ effect. The light-green, long-dashed lines show the previously published data 
by G08, and the blue, dot-dashed lines are the best amplitude fits. 
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Figure 4. Dependence of the results on the different WMAP data releases. 
Most results vary little compared with the size of the error bars; the largest 
changes can be seen in NVSS, bringing the results closer to the ACDM ex- 
pectations. The error bars on 2MASS are again 0.5-cr. 



By analytically maximising the likelihood, we obtain that the best 
value A and its variance for each catalogue are: 



7" 



7" 



I 

'■7=1 



CJjgigj 



(11) 



where wj s are the observed CCF for each survey (sampled in 
p = 13 angular bins) and dj is the measured covariance matrix of 
dimension p described above. To obtain an unbiased estimator of 
the inverse covariance CJ? , we correct the resu lt obtained by invert- 
ing Qj by a factor a = (N - p - 2)/(N - 1) faartlap et ai]|2007l) ; 
however in our case (for N = 5000 realisations) this correction 
is negligibly small. This method can be immediately generalised 
to the full case, in which we fit a single amplitude to a template 
which includes the six CCFs. In this case the total number of angu- 
lar bins, and thus the dimension of the covariance matrix, becomes 
p = 6 x 13 = 78. 

The results with this method and the new data are given in 
Table [2] where we can see that if we identify the signal-to-noise 
ratio as S/N = A/cr A , then the total significance of a detection is 
now at the 4.4 a level when a single amplitude is used for all six 
catalogues. 
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Catalogue 


A±(T A 


S/N 


expected 5 /N 


2MASS cut 


1.40 ±2.09 


0.7 


0.5 


SDSS gal DR8 


1.24 ±0.57 


2.2 


1.6 


SDSS LRG DR7 


2.10 ±0.84 


2.5 


1.2 


NVSS 


1.21 ±0.43 


2.8 


2.6 


HEAO 


1.37 ±0.56 


2.4 


2.0 


SDSS QSO DR6 


1.43 ±0.62 


2.3 


1.7 


TOTAL 


1.38 ± 0.32 


4.4 ±0.4 


a 3.1, < 7.6 



Table 2. Results from the updated data set compared with the expected 
signal-to-noise calculated using Eq. (6) for each catalogue. The first five 
data points for 2MASS have been excluded. For the total expected S/N, we 
show both the value estimated from the MC mocks (see below), and using 
the upper limit of Eq. (5j. We estimate a ~ 0.4 cr systematic error on the 
total signal-to-noise ratio, due to possible different masks and other choices 
entering into its determination. 



It is worth noticing that our significance estimation is however 
based on a fiducial model which includes not only the WMAP7 
best-fit parameters, but also the assumed redshift distributions and 
simple bias model of the surveys. While this is reasonable to give 
an initial estimate of the significance of the detection, a full cosmo- 
logical analysis should ideally take into account the uncertainties 
in these quantities, e.g. with the help of additional nuisance param- 
eters. The assumption of constant biases is especially uncertain, in 
particular for very deep catalogues like HEAO and NVSS (see e.g. 
ISchafer et alj |2009), and this issue should be addressed in a full 
cosmological analysis allowing for a more realistic bias evolution. 
The different assumptions for the biases and for the redshift distri- 
butions may f or example expla in the difference between our results 
and those by iHo et al.1 ( 2008), where a higher excess signal was 
found, at the 2 cr level above the ACDM predictions. 

In Table [2] we also compare the results with the expected 
signal-to-noise calculated using Eq. (6]l for each catalogue, and us- 
ing the upper limit of Eq. ([5} for the total. We can see that the mea- 
sured results are higher than the expectations in most cases. Given 
this discrepancy exists between expectations and observations, we 
next proceed to quantify its significance by studying the distribu- 
tion of the ISW signal-to-noise obtained using our 5000 mock maps 
of the galaxy surveys. We show these distributions in Fig. [5] here 
we can see that they are broad, and the position of the observed 5 /N 
is well within the expected scatter. In more detail, we fit a Gaussian 
to the distribution of the mock total signal-to-noise, where we find 
that the mean (i.e. the expectation for the total S /N from ACDM) 
is 3.05, and the r.m.s. is 1 by construction. This places our observed 
result 1.35 cr away from the mean. 

A further interesting point to be learnt from Fig.|5]is the com- 
parison between theoretical S/N with (green solid lines) and with- 
out (green dashed lines) shot noise. We can see that the effect of 
shot noise is particularly large for the quasars, due to their limited 
number density. From this we conclude that future measurements 
of extended quasar catalogues have the potential to significantly 
improve the existing results, due to the large redshift coverage of 
these sources. 

Given the number of different assumptions in the method of 
the analysis, we roughly estimate that a systematic uncertainty of 
^ 0.4 needs to be included on the final figure of the signal-to-noise 
ratio. For example, using other reasonable redshift distributions for 
the catalogues typically results in changes of the signal-to-noise ra- 
tio of the order 0.2 - 0.4. Similar differences are obtained when 




-2 24 -2 24 -2 24 
S/N 




2 4 6 

total S/N 



Figure 5. Distribution of the signal-to-noise ratio for our 5000 MC reali- 
sations (blue histograms), compared with the observations (red solid lines) 
and the theoretical expectations (green). The different green lines refer to: 
no shot noise (short-dashed), and shot noise included (long-dashed). The 
top panel shows each catalogue separately, the bottom panel is the full com- 
bination, for which we also show the best-fit Gaussian distribution and its 
parameters. 



changing the thresholds in the extinction masks, or excluding parts 
of the data (such as the Southern hemisphere for the new SDSS 
DR8 galaxies). Another change which is typically at the same level 
is produced if we decide to completely discard the pixels near the 
edge of the survey, for which the mask weighting is ff < 1, in- 
stead of correcting them with the appropriate weights. Furthermore 
any extra large-scale power in the auto-correlation functions, which 
could arise e.g. due to low-redshift contamination or other system- 
atics, would increase the variance of the cross-correlations. We dis- 
cuss this below in Section [5.3.2| showing that its effect is limited 
and in agreement with our systematic estimation of 0.4 cr. 

We have also checked the effect of removing any one cata- 
logue from the analysis, finding in this case that the total signifi- 
cance can not be lowered below 3.9 cr, which is the result obtained 
when ignoring the NVSS data. 
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We publicly release the maps, masks, and results discussed 
herein, which can be downloaded from the internet^] Here one can 
find for each of the six catalogues the following data: a file with the 
Healpix galaxy map in FITS format, and its companion mask in the 
same format; a table with the redshift distribution, and a table with 
the results of the CCFs. Finally, the full covariance matrix based on 
Monte Carlo maps is also provided. 



4 SYSTEMATIC UNCERTAINTIES 

Since the ISW signal is expected to be weak, possible systematic 
uncertainties are a serious issue. Here we discuss some of the new 
tests we have explored to constrain this contamination, and further 
discussion can be found in G08 and earlier work. 



4.1 Foreground contamination 

While individual instrumental systematics are not expected to be 
correlated between surveys, the cross-correlation could be con- 
taminated by extra-galactic sources in the microwave frequen- 
cies, such as synchrotron emission or the Sunyaev-Zel'dovich ef- 
fect. Our galaxy also emits in the microwave (dust, synchrotron 
and free-free), so it is important to ensure that galactic structure 
does not creep into the large-scale structure measured in surveys; 
otherwise spurious correlations with the CMB foregrounds will 
bias the cosmological interpretation of the measurements. Another 
possible source of cross-correlation is the secondary Doppler ef- 
fect which may be added to the C MB at the time or reionisation 
dGiannantonio & Crittendenl2007l) ; however, at the redshifts of cur- 
rently available data, this is expected to be completely subdomi- 
nant. 

An important way to keep foreground contamination under 
control is to check for dependence of the cross-correlation func- 
tions on the CMB frequency, as we expect the ISW signal to be 
monochromatic while the extra-galactic and galactic foregrounds 
sources such as SZ, synchrotron and dust are expected to have a 
strong frequency dependence. We have performed this test for the 
new data, and the results can be seen in Fig.|6j the cross-correlation 
functions are quite stable relative to the measurement error bars 
for the less contaminated WMAP maps (ILC, W, V, and largely Q). 
The m ost dependent on frequency is 2MASS, where lAfshordi et al] 
d2004> suggested there was evidence for the SZ effect; the most 
stable is HEAO, which is perhaps understandable as the hard X-ray 
background should be least affected by galactic contamination. 

Perhaps the most worrying systematic problem which can af- 
fect the ISW measurement is the leakage of information from the 
structure of our Milky Way into the galaxy catalogues. This can 
potentially jeopardise the results, as it correlates with the CMB 
via residual dust extinction corrections. This problem can be min- 
imised by masking sky areas closest to the galactic plane, and those 
areas most affected by reddening, which we have done for all cata- 
logues. 

We have also checked for the effect of removing from the 
maps a band centred on either the ecliptic or galactic planes, us- 
ing cuts of different widths (10, 20 and 30 degrees). We have found 
no significant differences. Other possibile systematics include the 
effects of point sources, regions of poor seeing and sky brightness; 
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Figure 6. Frequency dependence of the cross-correlations, for WMAP7: 
most results are stable compared with the size of the error bars. The error 
bars on 2MASS are again 0.5-cr. 



as discussed in G08 they are less severe than dust extinction for our 
data. 



For the DR7 MegaZ LRG data set there is excess power in the 
correlation with the CMB, at a similar level as found with DR6; ex- 
cess large-scale power has also been seen in the MegaZ LR G auto- 
correlation function as discussed bv lThomasetai] ( l2011ij) . While 
these excesses may be cosmological, they could also be evidence of 
remaining systematic s, such as a higher than expected stellar con- 
tamination. Recentlv. lRoss et al] ( l2011b1) improved the methods for 
selecting and interpreting an LRG catalogu e, using a large spectro - 
scopic training set from SDSS-III BOSS fcisenstein et alJuOl lb . 
These authors found that the most serious systematic problem with 
present photometric redshift catalogues from SDSS imaging is the 
failure to detect faint galaxie s around foregroun d stars (even rela- 
tively faint stars to r ^ 20). iRoss et all d201 lbl) corrected this is- 
sue, but it does illustrate the need to be diligent about stellar con- 
tamination, especially when cross-correlating with other datasets 
which may also include some contamination with galactic sources. 
In the future, catalogues with this higher level of systematics con- 
trol should be used for the measurement of the ISW. The ISW signal 
seen in the LRG cross-correlation is higher than the ACDM expec- 
tation; if future LRG data will be more in accord with ACDM, the 
best-fit amplitude may well decline, but with the uncertainty also 
shrinking, the signal-to-noise ratio could remain at a similar level. 



4.2 The rotation test 

Although the presence of systematic effects has been studied rather 
carefully by several authors, it is possible some unaccounted un- 
certainty could remain in the data, thus compromising the measure- 
ments, and it is therefore worthwhile to look for new ways to check 
for such problems. 

One such test, based on arbitrary rotatio n s of the sky 
maps, was recently proposed by Sawangw it et alj d2010h . In this 
test, cross-correlation functions (CCF) are generated by cross- 
correlating the true maps, but after one of the maps has been rotated 
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Figure 7. The rotation test for our data, zero-lag case. In the top panel, for 
each galaxy catalogue, we show the evolution of the CCF at degrees as 
a function of the arbitrary rotation angle A<f, describing rotations around 
the galactic plane. The coloured lines show the observed results; the green 
shaded bands indicate 1 and 2 cr regions calculated by generating 500 mock 
Monte Carlo maps of the data. The black dashed lines are the averages seen 
in the same mock data, assuming a ACDM concordance model. The bot- 
tom panel shows the same test for rotations in different coordinate systems: 
galactic, equatorial, ecliptic and supergalactic. 



by som e arbitrary angle A<p relative to the other. In Sawangwit et al. 
d2010h rotations around the Galactic axis were chosen particularly 
to try to identify galactic contamination, but any axis choice is pos- 
sible. For a sufficiently large rotation Aip, one expects on average 
that there will be no correlation, though any particular measure- 
ment will have scatter reflecting the intrinsic variance in the mea- 
surement. (Any rotation leaves two poles fixed, implying a small 
amount of residual correlation, but in practice this is negligible.) 

The critical question is, how do we evaluate the significance 
of the rotated correlation functions? The most obvious comparison 
is to the variance of the intrinsic scatter, inferred from our Monte 
Carlo simulations. Are the rotated correlation measurements con- 
sistent with this intrinsic scatter or not? 



4.2.1 Assessing the significance 

One difficulty in making this comparison is that, for a given rotation 
axis, there are a limited number of rotations which are independent 
of one another due to the fact that the ISW signal is on relatively 
large angles. We use 500 Monte Carlo simulations to evaluate this; 
we create sets of CMB and galaxy maps with the expected signal 
for the ACDM model, and rotate them as we do the real data. In the 
top panel of Fig.[7Jwe show the average 'zero-lag' cross-correlation 
as a function of rotation angle, with the 1-cr and 2-cr regions shaded 
in green. We see that this is significant typically out to 30 degrees, 
implying that this is the minimum rotation required to provide an 
independent sample. 

For any given rotation axis, this leaves only 11 independent 
samples of the cross-correlation measure. If one or more of these 
are significantly higher the the r.m.s. amplitude, then this could 
be evidence for the systematic contamination. In the top panel of 
Fig. [7] we plot the 'zero-lag' cross-correlation for each of our cat- 
alogues. This shows that no significant outliers exist, and that the 
signal is generally highest when there is no rotation, apart from 
2MASS where the zero-lag signal could be cancelled by the SZ ef- 
fect. This is quantified in Table [3] where we count the number of 
rotations exceeding thresholds of 1-, 2cr (expected 32% and 5%); if 
anything, the number of high correlations seen in the rotated maps 
is lower than expected, though this discrepency is not significant. 
The observed number above the threshold should be binomially dis- 
tributed, which is very broad given the limited number of observa- 
tions. 

In S10, they looked instead at the number of rotations where 
the 'zero-lag' cross-correlation exceeded the true 'zero-lag' cross- 
correlation for that particular survey; that is, our zero degree value 
(denoted w 0j ). However, this is just one choice, with the drawback 
of being different for each data set i. Nonetheless, we also show 
this in Table[3] Again, for rotations about the galactic axis, we find 
none exceeding the true value for our data sets. 

We can increase our statistics and explore for the possibility of 
systematics associated with other reference frames by considering 
rotations about other axes. We have repeated the test with rotations 
using: galactic, ecliptical, equatorial and supergalactic axes. For the 
discussion below we ignore chance alignments of the various rota- 
tions, but it should be kept in mind that all these points may not 
be fully independent. The results are shown in the bottom panel of 
Fig. [7] All of the rotations are consistent with the expected scat- 
ter, showing no indication for a preferred rotation axis. This seems 
to support the hypothesis that the rotations are merely providing a 
measure of the intrinsic scatter and are not suggestive of a contam- 
inant associated with a single axis. The statistics are summarised 
in Table [3] where we can see that only 31% and 3% of the points 
lie above the 1-, 2-cr thresholds respectively. Excluding 2MASS, 
only 3% exceed the true value measured in the data; unfortunately, 
this statistic cannot be used directly to estimate a total significance 
because it will be dominated by maps with the least significant am- 
plitude. 

For a visual impression of this, we plot our results in Fig. [8] 
where the observed number of detections in excess of each thresh- 
old is compared with the 68% confidence regions drawn from the 
continuous generalisation of a binomial probability distribution. 
Here we can appreciate that the distribution of the points above the 
1- and 2-cr thresholds is fully consistent with the expected scatter 
and the number of points above the the true measure levels seems 
consistent with an average level of significance ~ 2 cr for each cat- 
alogue. 
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Zero-lag data only 


Catalogue 


> la + 


- multi-axes 


> 2cr * 


- multi-axes 


> wo; 


- multi-axes 


7MACC 

SDSS gal 
SDSS LRG 


n/ i i t(\cL\ 

U/ 1 1 \}J 10) 

4/11 (36%) 
5/11 (45%) 


19/4/1 (llotr\ 

16/44 (36%) 
16/44 (36%) 


0/1 1 (Cl°/r,\ 
VI 1 1 \\J /C) 

0/11 (0%) 
0/11 (0%) 


1/44 (2%) 
3/44 (7%) 


0/1 1 (0%) 
0/1 1 (0%) 


3/44 (7%) 
2/44 (5%) 


NVSS 
HEAO 
SDSS QSO 


3/11 (27%) 
1/11 (9%) 
2/11 (18%) 


11/44(25%) 
10/44 (23%) 
17/44 (39%) 


0/1 1 (0%) 
0/1 1 (0%) 
1/11 (9%) 


0/44 (0%) 
0/44 (0%) 
3/44 (7%) 


0/1 1 (0%) 
0/1 1 (0%) 
0/1 1 (0%) 


0/44 (0%) 
0/44 (0%) 
1/44 (2%) 


Total 
Expected 


15/66 (23%) 
21/66 (32%) 


82/264(31%) 
84/264 (32%) 


1/66 (2%) 
3/66 (5%) 


9/264 (3%) 
13/264 (5%) 


0/55 (0%) 


6/220 (3%) 



Table 3. Results of the rotation test with our data for the zero-lag CCF. The scatter is in reasonably good agreement with the expectations, and is smaller than 
in S10 data (see Table[5j. In the rotations around the galactic axis there are fewer outliers than expected, but the numbers become closer to the expectations 
when using a larger number of rotation axes. 



Template amplitude fitting 



Catalogue 


> ltr + 


- multi-axes 


> 2a- * 


- multi-axes 


> A, 


- multi-axes 


2MASS 
SDSS gal 
SDSS LRG 


0/11 (0%) 
4/1 1 (36%) 
6/1 1 (55%) 


12/44 (27%) 
17/44 (39%) 
17/44 (39%) 


0/11 (0%) 
0/11 (0%) 
1/11 (9%) 


3/44 (7%) 
3/44 (7%) 
2/44 (5%) 


0/1 1 (0%) 
0/1 1 (0%) 


2/44 (5%) 
0/44 (0%) 


NVSS 
HEAO 
SDSS QSO 


3/11 (27%) 
4/11 (36%) 
3/1 1 (27%) 


10/44 (23%) 
15/44 (34%) 
18/44(41%) 


0/11 (0%) 
0/11 (0%) 
1/11 (9%) 


2/44 (5%) 
0/44 (0%) 
3/44 (7%) 


0/11 (0%) 
0/11 (0%) 
1/11 (9%) 


0/44 (0%) 
0/44 (0%) 
3/44 (7%) 


Total 
Expected 


20/66 (30%) 
21/66 (32%) 


89/264 (34%) 
84/264 (32%) 


2/66 (3%) 
3/66 (5%) 


13/264(5%) 
13/264 (5%) 


1/55 (2%) 


5/220 (2%) 



Table 4. As above, for the template amplitude fitting. The scatter is here in even better agreement with the expectations. 



Thus we find no evidence for systematic contamination from 
the rotation tests and that the rotated cross-correlation measure- 
ments are consistent with those expected from the covariance ma- 
trix derived from Monte Carlo simulations. Indeed, the rotations 
are an alternative means of deriving the covariance and were used in 
early studies as a means of calculating it. Unfortunately, the number 
of possible independent rotations is limited, meaning it is difficult 
to derive a stable covariance from rotations alone. 



the figure, and in the results summarised in Table[4] that the results 
remain consistent over an increased population. 

The significance of these results can be better appreciated by 
considering the uncertainties on the number counts, shown in the 
lower panel of Fig. [8] Here we can see once again that not only 
are the 1- and 2-cr thresholds consistent with the distribution of the 
outlying data, but also the populations above the A, thresholds are 
consistent with a level of significance > 2 a for each catalogue (ex- 
cluding the 2MASS data, where the detection has low significance). 



4.2.2 Including full angular information 

For the discussion above, we have focused on the zero-lag cross- 
correlation following S10. However, this single bin contains only 
part of the ISW signal, and thus the significance derived from it is 
not as high as one gets when including the full cross-correlation 
function. For this reason, we repeat our analysis fitting to templates 
based on the predicted correlations expected in the WMAP7 best- 
fit cosmology. We use the covariance matrices obtained with the 
expected CCF; we plot the best-fit amplitudes of the rotated maps 
as a function of the rotation angle in the first panel of Fig. [9] The 
scatter of the A's from the rotated maps is in even better agreement 
with expectations, as can be seen in Table|4] Here, we see that only 
30% and 3% of the points lie above the thresholds of 1 cr and 2 cr. 
2% exceed the the level of the unrotated best-fit amplitude, denoted 
as Aj. 

We have also performed the multi-axes test in the amplitude 
fitting case, as shown in the second panel of Fig. [9] We can see in 



4.2.3 Application to \Sawanewit et al\ \2010\) data 

We have shown above that for our data, the results of the rota- 
tion test are in agreement with the Monte Carlo estimations of the 
variance; let us now disc uss the application to th e S10 data them- 
selves. It was claimed by Sawa ngwit et alj J2010) that the result of 
this test for multiple data sets (SDSS gal, NVSS, SDSS LRGs and 
AAOmega LRGs) was in contradiction with the claimed detection 
of the ISW, pointing instead towards strong unknown residual sys- 
tematics. 

By looking at Figure 14 in S10, we compile the statistics 
shown in Table [5] Here we can see that in total 39% of the ran- 
dom points obtained by arbitrary rotations are scattered at > 1 cr 
away from zero, while randomly we would expect this fraction to 
be 32%. If we instead choose the 2-cr threshold, we find a total of 
6/56 points above this threshold, corresponding to 11% compared 
to the expectation of only 5%. Alternatively following S10, we can 



© 2012 RAS, MNRAS 000,[T]{T9] 



The significance of the integrated Sachs-Wolfe effect revisited 13 



2 a 



1 a 



TOTAL 
SDSS QSO 
HEAO 
NVSS 
SDSS LRG 
SDSS gal 
2MASS 



e 
a 

i 

o 




1 1 1 - 



> 1 a A 

> 2 a O 
> w 0i □ 



alactic plane 
multi-axes ■ 

(68% intervals) 



_l_ 



60 



80 



2 a 



% above threshold 
1 a 




— i — , — i — | 

> 1 a A 

> 2 a O 
> A, □ 



alactic plane 
multi-axes ■ 

(68% intervals) 



20 40 60 80 

% above threshold 



Figure 8. Significance of the rotation test for our combined data, using 
WMAP7, zero-lag only (above) and full template amplitude fitting (below). 
The data points correspond to the percentage of realisations observed above 
any given threshold: 1 <x (blue triangles), 2 <x (red diamonds), and each cat- 
alogue's unrotated CCF w>oj or amplitude A, (green squares). These should 
be compared to the expected 1- and 2-cr fraction (vertical lines); the error 
bands are 68% confidence intervals assuming a binomial probability dis- 
tribution for the counts. The empty points and the dashed bands refer to 
rotations around the Galactic plane only, while the filled points and solid 
bands include data from all four rotation axes. 



choose the threshold to be the unrotated signal w 0l seen in the data; 
in this case we find that 13/48 points (27%) are above this mark, if 
we discard the points from AAOmega for which S 10 find no corre- 
lation. 



By including the expected errors on the counts of the outlying 
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Figure 9. The rotation test for our data, best amplitude case. In this case we 
show in the top panel the best fit amplitude, using all the angular informa- 
tion, and assuming a templated based on the best fit WMAP7 ACDM cos- 
mology; the bottom panel shows the same using multiple rotation axes: 
Galactic, Equatorial, Ecliptic and Supergalactic. 



points, we can see the uncertainties corresponding to the data by 
S10 in Fig. [TO] Here we plot, for each data set and for the total, 
the number of bins above each threshold of 1 cr, 2 cr, and the 'real' 
value of the CCF at no rotation wot (again, excluding the AAOmega 
data for this last case since here w , is not defined). We can see here 
a higher scatter than in our data, but this not unexpected given the 
lower number of realisation. By comparing the data with the 68% 
and 95% confidence intervals from the binomial distribution, we 
observe substantial agreement. 

With respect to the w , threshold, Fig.QJJindicates that NVSS 
and, to a lesser extent the SDSS 20-21, 19-20, and 2SLAQ LRGs 
are consistent with a significance level > 2 <r, while the other cat- 
alogues seem to have a lower significance level. Also, it should be 
mentioned that the error bars were calculated using a jack-knife 
method, which can often depend on the details of how the jack- 
knife was performed. In earlier studies, jack-knife error estimates 
have been seen to be somewhat smaller than those inferred from 
Monte Carlo methods dCabre et al.ll2007t) . This could explain why 
somewhat more of the random rotations appear significant in the 
S10 data compared to our analysis. Overall however, when consid- 



14 T. Giannantonio, R. Crittenden, R. Nichol and A. J. Ross 



2 a 



1 a 



TOTAL 

NVSS 

SDSS gal 20-21 
SDSS gal 19-20 
SDSS gal 18-19 
AAOmega LRGs 
2SLAQ LRGs 
SDSS LRGs 




O 
□ 



o 
□ 



—I — I — I — r 

> 1 o A 

> 2 a O 
> w„, □ 



A 95% 

I ;%2^68% 

A 




20 40 60 

% above threshold 



80 



Figure 10. Significance of the rotation test for the data of S10, for each 
individual catalogue and (on top) for the total. The data points correspond 
to the percentage of realisations observed above any given threshold: 1 <x 
(blue triangles), 2 cr (red diamonds), and each catalogue's unrotated CCF 
wo; (green squares). The expected 1- and 2-tr thresholds are overplotted 
with vertical lines. The error bands in this case are 68% (solid) and 95% 
(dashed) confidence intervals assuming a binomial probability distribution. 



Catalogue 


> 1 cr ^ 


> 2 a- * 


> 


wo; 


SDSS LRGs 


1/8 


13% 


0/8 


0% 


3/8 


38% 


2SLAQ LRGs 


2/8 


25% 


0/8 


0% 


2/8 


25% 


AAOmega LRGs 


4/8 


50% 


1/8 


13% 






SDSS gal 18 < r < 19 


5/8 


63% 


1/8 


13% 


3/8 


38% 


SDSS gal 19 < r < 20 


4/8 


50% 


2/8 


25% 


2/8 


25% 


SDSS gal 20 < r < 21 


3/8 


38% 


2/8 


25% 


2/8 


25% 


NVSS 


3/8 


38% 


0/8 


0% 


1/8 


13% 


Total 


22/56 


39% 


6/56 


11% 


13/48 


27% 


Expected 


18/56 


32% 


3/56 


5% 







Table 5. Results of the rotation test in Sawangw it et al.l l2010l) . By defini- 
tion, we would expect 32% (5%) of the points to be further than 1 cr (2cr) 
away from zero. 



ered with the results based on our maps, we find that the rotation 
test provides no significant evidence for residual systematics in the 
data. 



5 DISCUSSION 

A handful of other papers have appeared with results that seem to 
be in conflict with the more common approaches described above. 
The differences are centred on three main issues: large differences 
in the statistical significance of the results (with papers suggest- 
ing both higher and lower significance), questions related to new 
data sets and questions about systematic contaminations. We dis- 
cuss each of these in turn. 



5.1 Statistical significance 

5.1.1 Theoretical covariance 

The significance of the measurements is estimated given the full 
covariance between the data. This may be obtained using different 
methods: analytically ("theory" covariance), from the data them- 
selves (jack-knife or bootstrapping), or using Monte C arlos, which 
is our method of choice. It was shown already by ICabre etHl] 
d2007l) that all such methods should give consistent results (with 
fluctuations of order 10% between them), and G08 presented a 
comparison between MC and jack-knife (JK) covariances show- 
ing that the results were comparable, although the JK method was 
deemed less stable. Here we compare our baseline MC covari- 
ance with the theory (TH ) covariance calcul a ted analytica l ly. Ex - 
tending the derivat ions bv lCabre et ail d2007h : Iwhite et alj J2009h ; 
lRossetal.l ( l2011al) . we find for the element of the covariance be- 
tween two galaxy catalogues (', j in two angular bins ft, i?': 



I 



(&, &') = Cov \w Ts <(&) , w Tg K&') 
(2/+1) 2 



(12) 



P,[cos(§)] P, [cos(#')] Cov(c, rSi ,C, ') , 



where P t are the Legendre polynomials and the harmonic space 
covariance is given by 

1 



Cov(cf* cf") 



n. 



f-JSj /-rTT, tot 



(Cf gj + Sij/n^)] ,(13) 



21+ 1 

where 6,j is the Kronecker symbol. 

We find that the analytical covariance is comparable with the 
MC method used in our main analysis; the diagonal elements agree 
at the ~ 10% level. The significance of the detections is decreased 
in this case by ~ 10%: we find for the total combined result A™ = 
1.42 ± 0.34, i.e. S/N = 4. 1 when using the theory covariance. This 
is well within the expected fluctuations given the differences in the 
two procedures. 

5.1.2 Absolute versus relative probability 

When comparing results from different papers, one must be careful 
to ensure that they are asking the same questions. As discussed in 
G08 and S10, there are at least two ways of quantifying the signif- 
icance of the ISW detection; the method used in G08 and in much 
of the literature is, how much is the fit to the data improved by as- 
suming a cross-correlation of the shape predicted by the ISW effect 
in a ACDM model? By allowing a free amplitude for the expected 
cross-correlation shape, G08 found A^ 2 = 19 between the best fit 
amplitude and the hypothesis of no ISW cross-correlation, and the 
best amplitude suggested by the data was very close to that pre- 
dicted by ACDM. 

Another possible approach is simply to ask whether the null 
hypothesis, that there is no cross-correlation, has been ruled out, 
without assuming any particular alternative model. In G08 it was 
found that a simple chi-square test is still passed, i.e. the null hy- 
pothesis is not rejected by current data, having x\ = 67 for 73 
d.o.f. The absolute chi-square statistic is sensitive to the estimation 
of the error bars and correlations between measurements; further, 
ignoring the improvements to the fits when a well-motivated (or 
even better motivated, given the other evidence) alternative model 
is considered seems overly pessimistic. 

We have checked that the above-mentioned results by G08 
remain similar in the current updated version of the data: we ob- 
tain for the null hypothesis that x\ = 60.2, with 78 d.o.f. For the 
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WMAP7 cosmology this is reduced to^^, MAp = 41.6, and for our 
best fit amplitude model to kL, = 39.7. At face value, these num- 
bers still do not reject the null hypothesis. Further, the reduced x~ 
is small, potentially indicating that the covariance has been over- 
estimated. Nonetheless, as mentioned above, the most important 
quantity is the differential A^ 2 , which indicates a strong preference 
for the ACDM paradigm. 

We have also recalculated these results using the TH covari- 
ance: in this case we obtain results more in line with the expecta- 
tions for this number of degrees of freedom: for the null hypothe- 
sis xi = 88.4, which is weakly disfavoured at the 80% level, and 
^wmap = 72.9. While the difference between TH and MC results 
is unclear, it is important to notice that the differential between the 
null hypothesis and ACDM remain consistent at 15 < Ax 2 < 20. 

5.1.3 Predictions for best possible ISW measurement 

While so metimes cited as a s keptica l paper regarding the ISW, the 
work by iFrancis & Peacockl ( feOlObl) (FP) does not contradict the 
earlier ISW literature, though it is perhaps overly conservative in 
its discussion of the prospects for measuring the ISW signal. In 
their study, they repeat the 2MASS cross-correlation measurement, 
taking advantage of improved redshift determination of the 2MASS 
sources to divide the sample in three redshift bins. Their measure- 
ment of the CMB cross-correlation shows no detection, but a weak 
preference for ACDM models compared to no ISW signal. This 
is consistent with most measurements using 2M ASS JRassat et alj 
l2007l : lHo et al.l2008l;lGiannantonio et al]2008tl) apart from the ini- 
tial claims by Afshordi et alj 1 2004 ). The lack of detection is not 
surprising because most 2MASS objects are at lower redshifts com- 
pared to where the ISW signal is expected to arise. 

However, FP continue to say that the ISW signal might avoid 
detection in 10% of cases, even given "the best possible data". 
This seems more pessimistic than the well-known limits on the 
ISW detection, where the maximum signal-to-noise is capped at 
(S IN) < 8 - 10 for the fiducial ACDM cosmology. However, this 
depends significantly on FP's definition of "the best possible data"; 
their 10% prediction assumes a maximum redshift of z max = 0.7, 
which effectively cuts out 50% of the ISW signal, and so is not the 
best possible data from an ISW perspective. Including the whole 
redshift range reduces the number of cases where the ISW effect is 
not detected by an order of magnitude. It is also worth mentioning 
that FP calculate the fraction of cases where there exists strong ev- 
idence for the detection as Ax 2 > 5; however, any positive value of 
Ax 2 would indicate a preference for ACDM models compared to 
no correlation. 

In a companion paper, IFrancis & Peacockl ( feOlOal) calculate 
the expected ISW signal based on the observed 2MASS data. This 
will be a useful technique when applied to surveys probing redshifts 
where the ISW is most sensitive, as it provides a template to search 
for in the CMB maps. For the case of 2MASS, where no cross- 
correlation is seen, it predicts a larger ISW signal than is seen in 
WMAP, which is quite surprising given the 2MASS could only be 
sensitive to a fraction of the ISW present. However, this is primarily 
due to the much larger than expected power in their highest redshift 
bin, which has significantly lower galaxy density and is more prone 
to contamination. 



5.1.4 Significance and field to field fluctuations 

In another paper. lLopez-Corredoira et al] ( l2O10l) argue that the sig- 
nificances of ISW detections claimed by many authors are incor- 



rect, based on a mis-estimation of what they call "field-to-field fluc- 
tuations". Their analysis yields comparable results for the CMB- 
galaxy cross-correlation function to previous detections, but their 
estimates for the noise in the measurements are significantly higher. 
G08 and independently ICabre et alj d2006p estimate these uncer- 
tainties around ^ 0.2 uK. while lLopez-Corr edoira et al. I f2oToh 
have =s 0.35 to 0.6 fiK. 

The reason for this disagreement is unclear. The origin and 
calculation methods appear to be comparable to previous ap- 
proaches; they briefly discuss jack-knife, Monte Carlo, rotations 
and analytic methods. For jack-knives, they find comparable an- 
swers to previous approaches, while their application of other meth- 
ods yields much higher noise estimates and they argue that these 
are more appropriate. We have discussed above the rotation tests, 
which we view as consistent with ot her estimates. A nalytic ap- 
proaches have been performed before JCabre et alj|2007h . yielding 
results comparable to the other cov ariance methods, and the expla- 
nation of the lack of agreement with lLopez-Corredoira et all ^20 id) 
is not clear. 

Their differences in the Monte Carlo and analytic results are 
perhaps hardest to understand; one issue could be that the number 
of Monte Carlos that they perform (100) is small compared to what 
is required for many purposes. Earlier calculations typically have 
used thousands of simulations, in order to ensure convergence in 
the off-diagonal covariance and invertibility of the covariance ma- 
trix. However, fewer Monte Carlos on its own seems unlikely to be 
able to explain such a large magnitude difference in the diagonal 



covariance. 



It is worth noting th at a subset of the authors of 
lLopez-Corredoira et alj d2010h report a similar inconsistency with 
estimates of the noise in the galaxy aut o-correlation, drawing int o 
question previous BAO measurements dSvlos Labini et all 12009). 
This suggests the origin for the cross-correlation discrepancy may 
relate to their estimation of the large-scale structure fluctuations. 
However, to this point the discrepancy has not been explained sat- 
isfactorily in either the ISW or BAO context. 



5. 1.5 Comparison to the expected ISW signal 

Hernandez-Monteagudo ( 2010) presents an analysis critical of the 
ISW detections with the N VSS data set, one of the most analysed 



data s ets in this context jB oughn & Crittenden 2004; Nol ta et al] 
| 2004| ; |Pietrobon et alJl2006l ; lMcEwen et al.ll2008l ; iRaccanelli et alj 
2008; Schiavon et alj|2012f ). His results are somewhat mixed; on 
the one hand he confirms the measurement of a signal seen in the 
cross-correlation, and in the cross power spectrum (I ~ 10-25) at a 
weaker 2-cr level. However, he claims the theoretical signal should 
be 5-cr, significantly larger than what is observed. This statement 
seems at odds with other measurements using this data, which de- 
tected the ISW at the expected level but with a lower significance. 
It is not clear whether the expected amplitude or the inferred errors 
are r esponsible for this difference. 

Hernandez-Monteagudo ( 2010) also argues that the correla- 
tions arise on smaller scales than expected for the ISW. In the 
C ~ 2 — 10 region, which he argues should have half of the ISW 
signal-to-noise, he finds a low value compared to lHo et al] d2008l) , 
leading him to speculate that an unknown foreground systematic 
may be contributin g to the observe d ISW signal. Unfortunately, the 
disagreement with lHo et alj ( 120081) is not explained, and it is diffi- 
cult to guess its origin given limited details of the methods. 

Hernandez-Monteagudo's statement that half the signal 
should appear at £ < 10 is somewhat misleading. It is {SIN) 2 
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which adds cumulatively in multipole, not S/N, and only a quarter 
of the (5 /TV) 2 is expected for £ < 10. It is true that this implies S /N 
reaches half of its full value in this range, but this would be equally 
true for three other independent ranges of I. Unfortunately, it is 
problematic to take a low significance result and attempt to break it 
up into subsets where the expected signal-to-noise is of order one. 
Estimates of significance are usually taken into account using tem- 
plate fitting techniques which optimally combine the signal on all 
scales. 

5.1.6 Higher statistical significance 

Most detections of the ISW are performed using two-point statis- 
tics in real or multipole space, and they largely yield comparable 
answers. One exception to t his is the main galaxy survey detection 
found bv lCabreetal] f2006). which found a higher significance de- 
tection (total S/N = 4.7 with data from SDSS DR4 alone). This 
dis crepancy was trace d by G08 to be due to a particular cut made 
bv lCabreetai] d2006t> on the data (they were excluding galaxies 
with a large error on their Petrosian r magnitude); G08 was not 
able to justify this cut, and to be conservative used the lower sig- 
nificance answer found without it. The dependence of the answer 
on this particular cut is somewhat worrying and should be folded 
into the estimate of the systematic uncertainty. However it should 
be noted that many other similar cuts have been explored, rarely 
changing the answers significantly. 

In addition, other methods have been used to search for the 
ISW effect, including wavelet and stacking methods, and these have 
sometimes produced much higher S/N than is seen using the sim- 
pler two-point methods. For example, a number of wav elet methods 
have been used to analyse the NVSS cross-correla tion dVielva et alj 
I2006L iMcEwen et alj|2008l IPietrobon et alj|2006h and have some- 
times reported higher significances. However, interpretation of the 
associated significances are not as straightforward, and often they 
explore a large space of possible wavelet shapes and scales and 
report the highest significance detection without reference to the 
expected theoretical dependence. In such cases, there is an a poste- 
riori bias in the statistics; if one focuses on the cosmological con- 
straints from all the measurements, these appear to give comparable 
constraints on cosmological parameters to those from the two-point 
statistics. 

Using a different approach, iGranett et alj |2008) have looked 
for supercluster and supervoids in the SDSS data; stacking the 
CMB fields associated with these, they have observed a tempera- 
ture hot spot at the positions of the superclusters and a cold spot 
associated with the supervoids. The significance claimed is 4.4 <r, 
much higher than seen in the two-point statistics. Were the fluctua- 
tions Gaussian, which is expected on these large scales, we would 
expect that correlating peaks is not as optimal compared to a full 
two-point measurement, so the higher significance is surprising. 
However, there is some a posteriori bias imparted when choosing 
how many superclusters to stack, and how large a patch to consider, 
which may contribute to the higher sig nificance. 

In a later paper I IGranett et al.ll2009D the same authors gener- 
ated a linear map of the time derivative of the gravitational poten- 
tial traced by SDSS LRGs, using a Voronoi tessellation technique. 
While cross-correlations of this map with the CMB reproduced the 
expected ISW signal at the expected significance level of ~ 2 <r, 
this ISW map failed to show any signature associated with the su- 
perclusters and supervoids of the earlier detection: the mean tem- 
perature of the clusters and voids on the ISW map was not signifi- 
cant, as the temperature difference between clusters and voids was 



found to be compatible with zero, contradicting the suggestion that 

the signal is due to the linear IS W effect. 

The excess signal found i nlGranett et al , (2008) h as been in- 
vestigated by various au thors (Papai & Szapudi 2010: [Papai et alj 
I20T it llnoue et alj 1201 0; Nadat hur et alj 120121) . who have shown 
that it is not easy to explain. Their tests have explored a range of 
different choices of density profiles for super-voids and -clusters 
and focused on the linear ISW theory as the origin; however no 
consensus has been reached on the level of disagreement. If this 
excess signal were to be confirmed and shown to be evidence of 
a higher-than-expected ISW effect, it could suggest a significantly 
different cosmological model; however, given the novelty of the 
method and possible new systematics, it is too early to draw any 
strong conclusions. 

5.2 New galaxy data sets 

In the coming years, deeper and wider cosmological surveys 
will improve the significance of ISW measurements (e.g. DES, 
PanSTARRS, WISE, LSST, Euclid). In the meantime, existing 
maps can grow to cover more area and/or be re-analysed to ob- 
tain new photometric subsamples. For example, S 10 explored three 
new LRG catalogues at low, medium and high redshifts using the 
existing SDSS imaging data. The low redshift catalogue has a depth 
of z = 0.35 ± 0.06, similar to the SDSS main galaxy sample, but has 
relatively few galaxies making Poisson noise a dominant source of 
error. The medium redshift 2SLAQ sample most closely approx- 
imates the MegaZ LRG sample, but with approximately half as 
many sources; it has a cross-correlation signal consistent with that 
seen for the MegaZ data as discussed above. The most interesting 
ISW result of S10 arises from their high redshift catalogue based 
on photometric LRGs calibrated using a pilot AAOmega survey, 
extending to z = 0.7. While the low redshift catalogues simply 
see lower ISW significance than seen in other analyses, the high-z 
AAOmega sample appears inconsistent with any ISW detection at 
all. 

One concern is that the AAOmega sample is pushing the SDSS 
photometry to its usable limit. For example, AAOmega selected 
objects with i-band de Vaucouleurs magnitudes 19.8 < i'd c v < 
20.5, significantly dee per than the cut used by SPSS-Ill BOSS 
(Eisen stein et aljfeoi ll) and studied in iRoss et alj d2011bl) of ap- 
proximately ijev < 19.9. Furthermore, S10 selected their high- 
redshift LRGs using the riz colour selectio n technique as defined 
by Eqs. (2) throug h (6) of lRoss et al1 j2008). As shown in Fig. 1 of 
Ross et al. I d2008l) , these colour cuts can be quite narrow e.g., their 
priority B objects are defined to be within a colour range of only 
0.2 < (i — z) < 0.6, which contains most of the 0.6 < z < 0.7 
AAOmega redshifts. At such faint model magnitudes, we can ex- 
pect large photometric un certainties on the obse rved colours, as 
demonstrated in Table 6 of Scranton et aD |2005), who found that 
at 20 < r < 21 the true (independent) colour errors for red galax- 
ies (like LRGs) is 0.16 for (i - z), i.e., nearly half the width of the 
AAOmega colour selection discussed above. 

We would expect such photometric errors to cause consid- 
erable scatter about these AAOmega colour selection boundaries, 
preferentially leading to contamination from lower redshift and/or 
lower luminosity interlopers, as there are many more such galax- 
ies in the SDSS sample. Such contamination would lower the 
correlation function of the AAOmega sample and, interestingly, 
AAOmega high-redshift sample does possess the lowest auto- 
correlation function of all three samples used by S10. Finally, it 
must be remembered that the photometric cuts are based on only 
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1270 calibration AAOmega spect ra, 587 of which were confirmed 
to be LRGs (see lRoss et alj|2008j) . and this small sample was then 
extrapolated to 800,000 galaxies in the high-z photometric sam- 
ple (~ 2000 additional LRG spectra were used to constrain the 
AAOmega redshift distribution). For comparison, the MegaZ sam- 
ple we use herein was calibrated using 13,000 spectra. 

Stellar contamination is another acknowledged issue. In S10, 
this contaminant is estimated to be at the 16% level in the full sam- 
ple of 800 000 high-z LRGs, and at the 9% level in a smaller 
cleaner data set, as also confirmed by the anal ysis of the auto- 
correlation of the LRGs dSawangwit et alj|201 ll) . However, even 
this reduced level is still a significant concern and it could un- 
dermine the usefulness of this catalogue for ISW measurements 
where the expected signal is weak. For comparison, the MegaZ 
LRG and the SDSS QSO samples used in G08 had both a < 5% 
stellar contamination, and there it was found that any higher con- 
tamination was degrading the data quality beyond usability for the 
cross-correlation purposes. While it is expected that a component 
of random stars ought to have null correlation with the CMB, it may 
correlate with foregrounds (e.g., Galactic dust and stars both trace 
the structure of the Galaxy), and it will in any case add to the overall 
noise level, which is already high in these studies. Further, the auto- 
correl ation of the AAOmega sample is shown bv lSawangwit et alj 
J201 1) to decrease significantly on large scales when areas with 
A r > 0. 1 are masked, thus showing that there is a correlation be- 
tween the AAOmega sample and Galactic foregrounds. 

These considerations suggest that the AAOmega sample is not 
well-suited for an ISW measurement. It is interesting to see whether 
or not the ISW effect can be detected with this data set, but perhaps 
it should not be interpreted on the same footing as the other, lower 
redshift SDSS samples. The lack of a cross-correlation found by 
S10 should be tracked in the future with better quality data at a 
similar redshift, but at present it is hard to draw conclusions from 
it on the general nature of the ISW effect. 



5.3 Systematics 

5.3.1 The rotations as a test of systematics 

The rotation tests were discussed in detail above; however, we em- 
phasise that systematic contamination would most likely appear as- 
sociated with rotations about a single axis, and we find no axis with 
any particular signal beyond what is expected from the estimated 
covariance. In general, if the number of outliers were much higher 
than expected, this would most likely indicate a mis-estimation of 
the covariance rather than indicating a particular new systematic 
contaminant. The observed consistency seems to confirm our esti- 
mates of the significance of the ISW effect. 



true physical effect arising from an evolving or a scale-dependent 
bias, the latter pred i cted by models of p rimordial non-Gaussianity 
jDalal et alj 120081; Isiosar et alj 120081; lAfshordi & Tollevl 120081; 
Matarrese & Verdel2008l ; lGiannantonio & Porcianil201fj| ; lxia et alj 
201cLl201lh . 

Generally, cross-correlations should be more robust to fore- 
ground contaminants than auto-correlation measurements; in this 
case the radio foregrounds would have to be correlated with the 
CMB. Though not impossible given that radio sources can emit in 
the CMB frequencies, it would be surprising if large-scale cross- 
correlations were introduced at precisely the level to match cross- 
correlations seen in other surveys and what is expected theoretically 
from ACDM models. 

To further test the possible consequences of the excess power 
in the ACFs, we have modelled this as an extra low-redshift con- 
tamination in the catalogues. We have found that we can reproduce 
the observed excess large-scale auto-correlations by adding a low- 
redshift Gaussian spike in the redshift distribution of the form 



£p{z) = <p(z) + A z ■ max [<p(z)] ■ exp 



20-? 



(14) 



where max [(p(z)] represents the maximum of the unaltered distri- 
bution (f(z). Some freedom exists with respect to the parameters of 
the spike (A., p., cr.), which can also be different for each galaxy 
catalogue; we have found that a conservative combination for these 
parameters is p z = 0.02, cr- = 0.01, and A ; = (0.5, 1,0.2,2, 1, 1) 
for the six galaxy catalogues respectively. This is conservative in 
the sense that it produces more excess power than it is observed. 
When using these modified redshift distributions, the CCFs remain 
unaffected, as the ISW effect has a negligible contribution at these 
low redshifts; on the other hand, the ACFs increase as expected. 
When using these spectra for the analytical covariance, we then 
obtain larger error bars on the cross-correlation due to this extra 
power. For this particular setting, the total ISW significance drops 
to ~ 3.4 cr. 

This is a rather extreme case, since as the low-redshift spike 
is present in all catalogues, it will produce high correlations be- 
tween the catalogues, which are at odds with the observed density- 
density correlation functions. To consider an intermediate, more re- 
alistic case, we study the scenario where low-z spikes are added 
where there is a clear excess in the auto-correlations: main galax- 
ies, NVSS, and quasars only, with A z = (0, 0.8, 0, 1.5, 0, 1). In this 
case we find that the total significance is S /N = 3.8. 

Therefore we estimate that even in the worst-case scenario, 
low-redshift contamination can not affect the significance of our 
measurement by more than 1 cr, while in more realistic cases this 
is significantly reduced, and its effect is therefore compatible with 
the systematic error of ±0.4 cr which we quote. 



5.3.2 Large-scale power in NVSS and bias modelling 

While systematic errors are not pointed to by the rotations, that 
is not to say there are no causes for concern. One significant is- 
sue with NVSS, highlighted by Hernandez-Mo nteagudo and in 
other work telake & Walll 20021 ; iBlake et alj2004h . is that the auto- 
correlation signal of NVSS on large scales is significantly higher 
than what is expected in ACDM models, even when consider- 
ing only the brightest source s in the NVSS survey. This confirms 
earlier results on the NVSS dRaccanelli et alj|2008f) and may im- 
ply the existence of a systematic or incorrect modelling of the 
redshift distribution. (However, no indications of this have been 
seen in cross-correlations with other surveys.) It could also be a 



6 CONCLUSIONS 

In this paper we have updated our compilation of ISW measure- 
ments to the latest available data, finding consistent results with 
previous studies, a mild (1-cr) excess signal with respect to the ex- 
pectations from the ACDM model, and an updated overall signifi- 
cance of 5 IN = 4.4 ± 0.4. We have performed additional tests on 
the combined ISW measurements, finding no evidence for system- 
atics. In particular, we concluded that the rotation test is not an issue 
for our data, and appears to be of little significance for the data by 
S10. We have shown that our correlation data remain robust with 
the latest WMAP7 release of CMB data, and with the final SDSS 
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DR8 imaging. We have discussed the impact of several issues and 
criticisms which have arisen in the literature in the recent years, 
concluding that most of the issues are not serious problems for the 
use of the ISW as a cosmological probe. We have publicly released 
all the data, including the maps and the masks for the LSS cata- 
logues. Improvements in the statistical analysis and cosmological 
consequences will be presented in a forthcoming paper. 

It is clear that, if the ACDM model is the true underlying 
model of cosmology, the significance of the ISW effect will remain 
lower than some other cosmological probes; however, it represents 
nonetheless a unique signal which allows us to independently con- 
firm the presence of dark energy through its impact on structure 
growth and potentially detect deviations in how gravity works to 
build cosmic structures. Upcoming data from ongoing and future 
surveys, such as e.g. DES, PanSTARRS, WISE, LSST and Euclid, 
will be crucial for answering these questions, and to push the sig- 
nificance of the ISW detections close to its theoretical limits. 
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